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(5)  Introduction 


Treatment  of  breast  cancer  at  an  early  stage  can  significantly  improve  the  survival  rate  of 
patients.  Mammography  is  currently  the  most  sensitive  method  for  detecting  early  breast  cancer  [1, 
2],  and  it  is  also  the  most  practical  for  screening.  Although  general  rules  for  the  differentiation 
between  malignant  and  benign  lesions  exist,  in  clinical  practice,  only  15-30%  of  cases  referred  for 
surgical  biopsy  are  actually  malignant.  A  number  of  research  groups  are  in  the  process  of 
developing  computer-aided  diagnosis  (CAD)  methods  which  can  provide  a  second  opinion  to  the 
radiologist  for  the  detection  and  classification  of  breast  abnormalities. 

Radiologists  routinely  use  several  mammograms  of  different  views  of  a  patient  with  those 
obtained  in  previous  years  for  identifying  interval  changes,  detecting  potential  abnormalities,  and  in 
evaluating  breast  lesions.  It  is  widely  accepted  that  interval  changes  in  mammographic  features  are 
very  useful  for  both  detection  and  classification  of  breast  abnormalities.  Some  existing  CAD 
techniques  use  information  from  multiple  views  of  the  same  breast.  Others  use  previous 
mammograms  for  detection.  However  none  incorporates  information  about  the  temporal 
mammographic  changes  in  the  brehst  tissue  for  classification. 

The  goal  of  this  project  is  to  evaluate  the  usefulness  of  using  interval  changes  to  distinguish 
between  normal  structures,  benign  masses,  and  malignant  masses  in  CAD.  The  purpose  of  this  study 
is  summarized  as  follows:  1.  Characterize  temporal  changes  in  terms  of  the  mammographic  features 
of  normal  breast  structures,  as  well  as  benign  and  malignant  masses.  2.  Use  this  information  to 
develop  methods  for  CAD.  We  hypothesize  that  the  use  of  temporal  changes  in  mammographic 
features  between  current  and  previous  mammograms  of  the  patient  will  improve  the  success  of  CAD 
technique  for  classification  of  masses.  It  is  therefore  expected  that  the  use  of  such  temporal 
information  will  improve  the  positive  predictive  value  of  mammography  by  reducing  benign 
biopsies,  and  hence  reduce  both  cost  and  patient  morbidity. 

To  accomplish  this  goal  we  will  first  develop  and  evaluate  reliable  techniques  for  the 
temporal  regional  registration  of  mammograms  of  the  same  patient.  The  temporal  mammogram 
registration  technique  we  have  developed  is  a  novel  approach  in  which  the  computer  emulates  the 
search  method  used  by  many  radiologists  for  finding  corresponding  structures  on  mammograms.  The 
method  aims  at  registering  a  small  region  containing  a  suspected  mass  on  the  most  recent 
mammogram  of  the  patient  with  one  on  a  mammogram  obtained  from  a  previous  year.  Our  regional 
registration  technique  involves  three  steps:  (1)  identification  of  a  suspicious  structure  on  the  most 
recent  mammogram,  (2)  initial  estimation  of  the  location  on  a  previous  mammogram  of  the  region 
corresponding  to  the  suspicious  structure  and  the  definition  of  a  search  region  which  encloses  the 
object  of  interest  on  the  previous  mammogram,  and  (3)  accurate  identification  of  the  location  of  the 
matched  object  within  the  search  region.  The  characteristic  features  of  the  two  matched  lesions  then 
will  be  automatically  extracted  and  interval  changes  estimated.  This  interval  change  information  will 
be  incorporated  in  an  integrated  CAD  system. 
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(6)  Body 

In  the  first  year  (4/6/98-4/5/99)  of  this  grant,  we  have  performed  the  following  studies: 

(A)  Database  collection  and  extraction  of  regions  of  interest 

We  collect  the  data  set  for  this  study  from  the  files  of  patients  who  had  undergone  biopsy  at 
the  University  of  Michigan.  The  mammograms  are  scanned  and  the  images  are  saved  in  our  storage 
device  using  automated  graphic  user  interface  developed  in  our  laboratory.  Additionally  the  film 
information  is  recorded  in  a  Microsoft  Access  database.  Temporal  pairs  of  images  were  obtained. 
The  current  mammogram  of  each  temporal  pair  exhibited  a  biopsy-proven  mass.  We  scan  both 
cranio-caudal  and  mediolateral-oblique  views.  The  mammograms  were  digitized  with  a  LUMISCAN 
85  laser  scanner  at  a  pixel  resolution  of  0.05  mm  x  0.05  mm  and  with  12-bit  resolution. 

While  the  regional  registration  technique  can  be  used  for  determining  a  corresponding 
structure  or  region  for  any  structure  (both  normal  tissues  and  masses)  in  the  breast,  in  this  study  we 
are  analyzing  its  accuracy  on  biopsy-proven  masses  alone.  The  location  of  the  mass  on  the  current 
mammogram  identified  by  an  MQSA-approved  radiologist  experienced  in  breast  imaging  using  an 
interactive  image  analysis  tool  on  a  UNIX  workstation.  To  provide  the  ground  truth  for  evaluation  of 
the  computerized  method,  the  radiologist  manually  identifies  the  corresponding  region  on  the 
previous  mammogram.  Bounding  boxes  enclosing  the  mass  on  the  current  mammogram  and  the 
corresponding  object  on  the  previous  mammogram  are  also  provided  by  the  radiologist  for  each  case. 
Each  mass  as  well  as  the  corresponding  structure  on  the  previous  mammogram  are  rated  for  its 
visibility  on  a  scale  of  1  to  10,  where  the  rating  of  1  corresponded  to  the  most  visible  category.  The 
size  of  the  mass  on  the  current  mammogram  as  well  as  the  size  of  the  corresponding  structure  on  the 
previous  mammogram  are  also  measured  by  the  radiologist.  The  parenchymal  density  is  rated  based 
on  the  BI-RADS  lexicon. 

(B)  Segmentation  of  mammograms  to  distinguish  between  breast  and  background 

In  the  first  step  of  regional  registration,  the  breast  region  is  segmented  from  the  background 
on  both  the  current  and  the  previous  mammograms.  For  this  purpose  we  have  used  a  breast  boundary 
detection  algorithm  previously  developed  in  our  laboratory  [3,  4].  This  algorithm  could  successfully 
track  the  breast  boundaries  in  over  90%  of  the  1000  mammograms  in  a  previous  study.  It  performed 
reliably  well  on  all  the  images  in  our  database.  After  extracting  the  breast  border  from  the 
mammogram,  the  location  of  the  nipple  is  estimated  on  both  the  current  and  the  previous 
mammograms.  Any  automated  method  [5,  6]  can  be  used  for  finding  the  nipple  location.  However, 
at  this  stage  of  the  project,  the  nipple  location  is  manually  identified  by  a  radiologist  for  all  images  in 
our  data  set. 


(C)  Develop  methods  for  establishing  corresponding  locations  in  current  and  previous 
mammograms 

The  breast  border  and  the  nipple  location  form  the  basis  of  a  global  breast  alignment  (GBA) 
procedure.  Since  the  sizes  and  the  orientations  of  the  two  images  could  vary  between  the  current  and 
previous  mammograms,  a  common  frame  of  reference  is  needed.  The  GBA  procedure  has  been 
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devised  specifically  to  provide  such  a  frame  of  reference.  We  first  define  a  new  frame  of  reference 
with  the  nipple  location  on  the  current  mammogram  as  the  origin.  The  previous  mammogram  is 
translated  so  that  its  nipple  location  aligns  with  the  origin  in  the  common  frame  of  reference.  Using 
the  origin  as  the  pivot  point,  we  rotate  the  previous  mammogram  to  align  the  breast  regions  in  the 
two  images. 

We  have  evaluated  two  different  methods  for  estimation  of  the  optimum  rotation  angle.  The 
first  method  is  based  on  maximization  of  the  overlap  area,  and  the  second  method  is  based  on 
maximization  of  the  mutual  information  (MI)  [7,  8]  between  the  two  segmented  breast  regions.  To 
determine  the  MI,  we  first  rescale  the  breast  portion  of  both  mammograms  to  a  0-255  gray  scale. 
Then  we  compute  the  mutual  information  between  the  two  images  for  a  specific  rotation  angle 
0  (MIe).  This  procedure  is  repeated  for  several  rotation  angles  and  the  angle  ©max  which  provides 
the  maximum  MI  is  chosen  for  global  breast  alignment  of  the  previous  mammogram  and  the  current 
mammogram.  .  Once  the  two  images  are  aligned  in  the  common  frame  of  reference,  the  centroid  of 
the  breast  region  is  estimated,  and  the  nipple-centroid  axis  is  defined  for  both  mammograms.  For 
comparison,  we  also  show  in  Section  E  regional  registration  results  based  on  computing  the 
centroids  of  the  two  breast  regions  without  global  breast  alignment.  The  nipple-centroid  axis  forms 
the  basis  for  the  second  step  of  regional  registration. 

In  the  second  step,  suspicious  regions  are  segmented  from  the  breast  region  on  the  current 
mammogram.,  The  centroid  of  each  object  is  estimated.  A  polar  coordinate  system  is  then  defined 
using  the  nipple  as  the  origin  and  the  nipple-centroid  axis  as  the  0°  axis  on  both  images.  The  location 
of  the  centroid  of  a  suspicious  object  on  the  current  mammogram  is  determined  as  (r,0).  We  then 
compute  two  scale  factors  -  the  radial  scale  factor  si  and  the  angular  scale  factor  S2.  These  scale 
factors  have  been  devised  to  provide  a  first-order  correction  for  factors  such  as  breast  compression 
differences  between  the  current  and  previous  mammograms,  differences  in  image  magnification  and 
size,  and  changes  in  overall  breast  shape  between  the  two  images.  The  radial  scale  factor  si  is 
estimated  as  the  ratio  of  the  nipple-centroid  distances  on  the  previous  and  current  images.  The 
angular  scale  factor  S2  is  estimated  as  the  ratio  of  the  angular  width  of  the  breast  on  the  previous 
image  at  radius  sir  to  that  on  the  current  image  at  radius  r.  The  initial  estimate  of  the  corresponding 
location  of  the  suspicious  object  on  the  previous  mammogram  is  then  obtained  as  (sir,  S20). 

Using  the  initial  estimate  of  the  centroid  of  the  object  on  the  previous  mammogram,  we  can 
define  a  fan-shaped  search  region  bounded  by  sir  +  5  and  S20±  £.  The  object  found  on  the  current 
mammogram  is  then  used  as  a  template  to  search  for  a  matching  object  in  the  search  region  on  the 
previous  mammogram.  The  size  of  the  search  region  (defined  by  8  and  e)  depends  on  the  variability 
between  mammograms  obtained  from  one  examination  to  the  other.  Since  it  is  difficult  to  predict  the 
variability  of  an  elastic  and  deformable  object  such  as  the  breast  by  any  analytical  method,  we  have 
determined  this  variability  experimentally  from  the  mammograms  in  our  data  set.  The  variation  in 
compression  can  cause  a  change  in  the  relative  locations  of  various  breast  structures  on  these  images 
as  well  as  a  rotation  of  the  breast  boundary  with  respect  to  the  fixed  image  coordinates.  By  relating 
the  position  of  a  breast  structure  to  the  corresponding  nipple-centroid  axis,  and  by  performing  a 
search  in  the  corresponding  search  region,  we  can  reduce  the  effect  of  this  variability.  In  this  study 
we  estimated  the  size  of  the  search  region  required  to  enclose  all  corresponding  objects  on  the 
previous  mammogram  using  ground  truth  objects  identified  on  the  previous  mammograms  by  a 
radiologist.  The  distance  of  the  initial  estimate  of  the  center  of  the  search  region  from  the  centroid  of 
the  ground  truth  object  was  also  estimated. 
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(D)  Develop  methods  for  correlation  of  breast  regions  in  current  and  previous  mammogram 

The  third  and  final  step  in  the  regional  registration  procedure  involves  a  systematic  search  to 
identify  a  corresponding  structure  within  the  fan-shaped  search  region  on  the  previous  mammogram. 
In  this  study  we  have  evaluated  two  different  search  criteria.  The  first  criterion  is  based  on  gray  scale 
template  matching.  A  rectangular  gray  scale  template  centered  on  the  mass  centroid  is  extracted  from 
the  current  mammogram.  The  choice  of  the  size  of  the  template  region  can  affect  the  accuracy  of  the 
registration  technique.  The  minimum  required  size  of  a  rectangular  template  is,  of  course,  a 
rectangular  region  which  encloses  the  mass  exactly.  However,  one  can  also  include  a  small  portion 
of  the  background  region  in  the  template.  We  have  analyzed  the  performance  of  our  algorithm  using 
two  different  sizes  for  this  template.  The  first  includes  a  1-pixel-wide  background  region  all  around 
the  boundary  of  the  suspicious  object  while  the  second  includes  a  5-pixel-wide  background  region. 
For  each  pixel  in  the  fan-shaped  region  on  the  previous  mammogram,  a  region  of  interest  (ROI) 
centered  on  the  pixel  and  of  the  same  size  as  the  mass  template  is  extracted.  A  correlation  measure  is 
then  obtained  for  each  pixel  within  the  search  region  on  the  previous  mammogram.  The  correlation 
values  in  the  search  region  are  then  smoothed  by  a  3x3  averaging  kernel  to  reduce  fluctuations.  The 
final  estimate  of  the  location  of  the  mass  centroid  on  the  previous  mammogram  is  obtained  as  the 
location  corresponding  to  the  maximum  correlation  value.  The  second  search  criterion  is  based  on 
maximizing  the  mutual  information  between  the  mass  template  and  the  ROI  extracted  from  within 
the  search  region.  The  MI  approach  is  similar  to  that  described  earlier  for  alignment  of  the  breast 
regions,  except  that  the  regions  to  be  matched  are  limited  to  the  size  of  the  mass  template. 

Once  a  corresponding  structure  is  found  on  the  previous  mammogram  for  a  suspicious  object 
on  the  current  mammogram,  it  can  be  used  for  an  interval  change  analysis  within  a  CAD  scheme,  as 
we  have  shown  in  an  independent  study  [9].  If  the  search  procedure  in  the  fan-shaped  region  does 
not  yield  a  corresponding  region,  then  the  suspicious  object  on  the  current  mammogram  can  be 
considered  as  a  newly  developed  density.  Objects  for  which  no  corresponding  object  can  be  found  on 
the  previous  mammogram  can  be  analyzed  with  methods  designed  for  single  images  in  an  overall 
CAD  scheme. 


(E)  Evaluate  accuracy  of  regional  registration  technique 

The  regional  registration  technique  has  been  evaluated  with  a  data  set  of  74  temporal  pairs  of 
mammograms. 

Initial  Estimates  and  Search  Regions 

The  Euclidean  distance  between  the  initial  estimate  of  the  centroid  location  of  the 
corresponding  structure  on  the  previous  mammogram  and  the  center  of  the  bounding  box  provided 
by  the  radiologist  was  estimated.  For  the  74  temporal  image  pairs  used  in  this  data  set,  the  average 
Euclidean  distance  error  of  the  initial  estimate  was  10.5  mm  (std.  dev.  6.4  mm)  without  the  GBA 
procedure  and  9.8  mm  (std.  dev.  6.0  mm)  with  the  GBA  procedure.  The  overall  accuracy  was  46%  in 
both  cases,  i.e.,  in  34  of  the  74  temporal  image  pairs  the  initial  estimate  was  inside  the  ground-truth 
bounding  box.  Based  on  observation  of  the  radial  deviation  errors  and  the  angular  deviation  errors,  a 
search  region  defined  by  e  =  0.35  +  5/r  radians  and  8  =  20  mm  with  GBA  (5  =  25  mm  for  no  GBA), 
where  r  is  the  radial  distance  from  the  nipple,  was  used  for  the  evaluation  of  the  local  search  criteria 
used  in  Step  3  of  regional  registration. 
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Local  Search  Criteria  and  Final  Estimates 


The  Euclidean  distance  errors  of  the  final  estimate  of  the  corresponding  structure  using  the 
correlation  measure  as  the  search  criterion  was  calculated.  Table  I  summarizes  the  results  along  with 
the  average  Euclidean  distance  errors  and  standard  deviations  using  both  the  correlation  and  the 
mutual  information  search  criteria  and  with  and  without  the  GBA  procedure.  The  average  Euclidean 
distance  errors  and  deviations  for  the  cases  where  the  final  estimate  is  inside  the  ground-truth  region 
identified  by  the  radiologist  and  the  cases  where  it  is  outside  are  also  listed  separately.  Regional 
registration  incorporating  the  GBA  procedure  and  using  correlation  as  a  search  criterion  has  an 
accuracy  of  85%.  In  63  of  the  74  temporal  image  pairs,  the  final  estimate  of  the  location  of  the 
corresponding  region  was  inside  the  radiologist-identified  ground-truth  region.  The  use  of  mutual 
information  as  a  search  criterion  yielded  an  accuracy  of  74%  (55  out  of  74  temporal  pairs).  The 
average  Euclidean  distance  error  for  regional  registration  incorporating  GBA  and  correlation  was  4.7 
mm  (std.  dev.  5.8  mm)  for  all  74  temporal  pairs  and  2.8  mm  (std.  dev.  1.9  mm)  in  85%  (63/74)  of  the 
temporal  pairs.  Use  of  mutual  information  as  a  search  criterion  in  Step  3  resulted  in  values  of  7.2  mm 
(std.  dev.  8.6  mm)  and  3.0  mm  (std.  dev.  2.0  mm),  respectively,  for  the  same  quantities. 

Table  I.  Accuracy  of  regional  registration  using  correlation  measure  and  mutual  information  measure  in  Step 
3  with  and  without  global  breast  alignment  (GBA)  and  using  a  1-pixel-wide  background  region  for  the 
template  from  the  current  mammogram.  Correct  estimates  are  the  cases  where  the  estimated  centroid  location 
was  within  the  bounding  box  of  the  radiologist-identified  object  location. 


Method 

Accuracy 

Overall  average 
error  (mm) 

Average  error  (mm) 
for  correct  estimates 

Average  error  (mm) 
for  incorrect  estimates 

Correlation  without  GBA 

77%  (57/74) 

7.4  ±  10.2 

2.8  ±  2.0 

22.9  ±  11.5 

MI  without  GBA 

68%  (50/74) 

8.8  ±  10.5 

3.0  ±  2.0 

20.7  ±  11.1 

Correlation  with  GBA 

85%  (63/74) 

4.7  ±  5.8 

2.8  ±  1.9 

15.7  ±  8.3 

MI  with  GBA 

74%  (55/74) 

7.2  ±  8.6 

3.0  ±  2.0 

19.4  ±  8.9 

(F)  Further  development  of  the  regional  registration  method 

We  will  continue  to  improve  the  regional  registration  technique.  In  the  first  step,  an 
automated  method  will  be  developed  to  detect  the  nipple  location  in  the  breast  image.  The  method 
will  be  based  on  both  the  change  of  tangential  direction  and  the  change  in  the  tissue  density  along  the 
breast  border.  In  the  second  step,  we  have  investigated  the  refinement  of  the  location  of  the  fan- 
shape  search  region  by  maximizing  a  correlation  measure  between  a  template  of  the  fan-shape  region 
defined  on  the  current  mammogram  and  the  breast  structures  on  the  previous  mammogram.  The 
local  refinement  is  carried  out  by  warping  of  the  fan-shape  region.  In  the  third  stage,  the  search  for 
the  best  match  between  the  lesion  template  from  the  current  mammogram  and  a  structure  on  the 
previous  mammogram  is  carried  out  by  fine  alignment  within  the  search  region.  Fine  alignment  of 
the  lesion  within  a  small  neighborhood  of  the  matched  region  is  performed  based  on  nonlinear 
simplex  optimization.  The  preliminary  results  of  this  study  are  promising.  The  average  Euclidean 
distance  between  the  computer  estimate  of  the  corresponding  structure  and  the  radiologist-identified 
location  and  their  standard  deviation  were  both  reduced.  We  have  submitted  an  abstract  on  this 
improved  method  for  presentation  at  the  upcoming  RSNA  meeting  [10]. 
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(7)  Conclusion 


During  this  year,  we  have  developed  a  multistage  regional  registration  technique  that 
combines  global  and  local  alignment  procedures  for  identifying  masses  on  temporal  pairs  of 
mammograms.  In  the  first  stage,  the  breast  images  from  the  current  and  previous  mammograms  are 
globally  aligned  by  maximizing  a  mutual  information  measure.  In  the  second  stage  a  fan-shape 
search  region  is  estimated  on  the  previous  mammogram.  In  the  third  stage  a  search  for  the  best 
match  between  the  lesion  template  from  the  current  mammogram  and  a  structure  on  the  previous 
mammogram  is  carried  out  within  fan-shape  region.  In  a  data  set  of  74  image  pairs,  we  found  that  in 
85%  of  the  cases  the  corresponding  regions  containing  lesion  on  the  previous  and  current 
mammogram  were  correctly  identified.  This  result  indicates  that  our  technique  is  a  promising 
approach  for  identification  of  corresponding  lesions  on  temporal  pairs  of  mammograms  and  thus 
may  be  used  as  a  basis  for  analysis  of  interval  change  on  mammograms.  We  will  continue  to  enlarge 
the  data  set  and  improve  the  registration  method  in  future  years. 
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(9)  Appendix 


1.  Key  research  accomplishments  in  current  year  as  a  result  of  this  grant 

•  Database  collection  and  extraction  of  regions  of  interest. 

•  Segmentation  of  mammograms  to  distinguish  between  breast  and  background. 

•  Development  of  methods  for  establishing  corresponding  locations  in  current  and  previous 
mammograms. 

•  Development  of  methods  for  correlation  of  breast  regions  in  current  and  previous  mammograms. 

•  Evaluation  of  the  accuracy  of  regional  registration  technique. 
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Registration  Technique  for  Automated  Interval  Change  Analysis  of  Breast  Lesions  on 
Mammograms,  Medical  Physics  1998  (submitted). 

[2]  L.M.  Hadjiiski,  H.P.  Chan,  B.  Sahiner,  N.  Petrick,  M.A.  Helvie,  S.  Sanjay-Gopal,  Automated 
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Automated  Identification  of  Breast  Lesions  in  Temporal  Pairs  of 
Mammograms  for  Interval  Change  Analysis 


Abstract: 

PURPOSE:  To  develop  a  registration  technique  for  automated 
identification  of  corresponding  lesion  on  a  previous  mammogram.  This 
technique  is  the  basis  for  interval  change  analysis  of  breast  lesions 
in  computer-aided  diagnosis  applications. 

METHOD/MATERIALS:  A  multistage  regional  registration  technique  that 
combines  global  and  local  alignment  procedures  was  developed  for 
identifying  masses  on  temporal  pairs  of  mammograms.  In  the  first 
stage,  the  breast  images  from  the  current  and  previous  mammograms  were 
globally  aligned  by  maximizing  a  mutual  information  measure.  An 
initial  fan-shape  search  region  was  then  estimated  on  the  previous 
mammogram  based  on  the  mass  location  on  the  current  mammogram.  In  the 
second  stage,  the  location  of  the  fan-shape  search  region  was  locally 
refined  by  maximizing  a  correlation  measure  between  a  template  of  the 
fan-shape  region  defined  on  the  current  mammogram  and  the  breast 
structures  on  the  previous  mammogram.  In  the  third  stage  a  search  for 
the  best  match  between  the  lesion  template  from  the  current  mammogram 
and  a  structure  on  the  previous  mammogram  was  carried  out  within  this 
search  region.  Fine  alignment  of  the  lesion  within  a  small 
neighborhood  of  the  matched  region  was  then  performed  based  on  simplex 
optimization.  A  set  of  74  temporal  pairs  of  mammograms  containing 
biopsy-proven  masses  was  used  to  examine  the  performance  of  this 
approach.  The  true  lesion  locations  were  identified  by  an  experienced 
radiologist  on  all  mammograms.  The  accuracy  of  the  multistage 
regional  registration  was  analyzed  by  evaluating  the  area  of  overlap 
between  the  estimated  and  the  true  lesions  on  the  previous  mammogram. 
The  average  distance  between  the  centroids  of  the  estimated  and  true 
lesion  locations  was  also  calculated. 

RESULTS:  In  this  study  89%  of  the  estimated  lesion  locations  result  in 
an  area  overlap  of  at  least  50%  with  the  true  lesion  locations.  The 
average  distance  between  the  estimated  and  the  true  centroid  of  the 
lesions  on  the  previous  mammogram  was  4 . 9±4  mm. 

CONCLUSIONS:  The  multistage  regional  registration  technique  is  useful 
for  identification  of  corresponding  lesions  on  temporal  pairs  of 
mammograms.  Further  studies  are  underway  to  improve  the  technique  and 
to  evaluate  its  accuracy  on  a  larger  data  set. 
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Abstract 


A  reliable  and  accurate  registration  technique  is  a  critical  requirement  for  a  computerized  analysis  of 
temporal  changes  on  mammograms.  We  have  developed  an  automated  regional  registration  technique  for 
identifying  corresponding  lesions  on  temporal  pairs  of  mammograms.  This  regional  registration  technique 
is  based  on  first  segmenting  the  breast  from  the  background  on  the  current  and  previous  mammograms. 
The  breast  edges  are  then  aligned  using  a  global  alignment  procedure  based  on  the  mutual  information 
between  the  breast  regions  in  the  two  images.  Using  the  nipple  location  and  the  breast  centroid  estimated 
independently  on  both  mammograms,  a  polar  coordinate  system  is  defined  for  each  image.  The  polar 
coordinate  of  the  centroid  of  a  lesion  detected  on  the  most  recent  mammogram  is  used  to  obtain  an  initial 
estimate  of  its  location  on  the  previous  mammogram  and  to  define  a  fan-shaped  search  region.  A  search  for 
a  matching  structure  to  the  lesion  is  then  performed  in  the  fan-shaped  region  on  the  previous  mammogram 
to  obtain  a  final  estimate  of  its  location.  In  this  study,  a  quantitative  evaluation  of  registration  accuracy  has 
been  performed  with  a  data  set  of  74  temporal  pairs  of  mammograms  and  ground-truth  correspondence 
information  provided  by  an  experienced  radiologist.  The  most  recent  mammogram  of  each  temporal  pair 
exhibited  a  biopsy-proven  mass.  We  have  investigated  the  usefulness  of  correlation  and  mutual 
information  as  search  criteria  for  determining  corresponding  regions  on  mammograms  for  the  biopsy- 
proven  masses.  In  85%  of  the  cases  (63/74  temporal  pairs)  the  region  on  the  previous  mammogram  that 
corresponded  to  the  mass  on  the  current  mammogram  was  correctly  identified.  The  region  centroid 
identified  by  the  registration  technique  had  an  average  distance  of  2.8±1.9mm  from  the  centroid  of  the 
radiologist-identified  region.  These  results  indicate  that  this  new  registration  technique  may  be  useful  for 
establishing  correspondence  between  structures  on  current  and  previous  mammograms. 

Keywords:  Image  registration,  computer-aided  diagnosis,  computer  vision,  interval  change,  breast 
cancer. 
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I.  INTRODUCTION 


Mammography  is  currently  the  most  effective  method  for  early  breast  cancer  detection1-2.  A  variety 
of  computer-aided  diagnosis  (CAD)  techniques  have  recently  been  developed  to  analyze  mammographic 
abnormalities  and  to  distinguish  between  malignant  and  benign  lesions3'8.  Knowledge  from  diverse  areas 
such  as  signal  and  image  processing,  pattern  recognition,  computer  vision,  artificial  intelligence,  and 
neural  networks  has  been  used  to  develop  algorithms  to  be  implemented  within  a  CAD  scheme.  Varying 
degrees  of  success  for  these  approaches  have  been  reported  in  the  literature.  One  common  feature  of  most 
of  these  CAD  techniques  is  that  they  use  a  single  mammogram  for  analysis.  Radiologists,  on  the  other 
hand,  routinely  use  several  mammographic  views  along  with  mammograms  obtained  in  previous  years  for 
identifying  interval  changes  and  for  detecting  and  evaluating  breast  lesions.  Comparisons  with  previous 
mammograms  have  been  found  to  have  a  positive  impact  on  clinical  management  and  cancer  detection^-10. 
Noteworthy  is  the  fact  that  some  malignancies  may  only  manifest  as  a  new  density  on  mammograms 
without  calcifications  or  distortions.  Therefore,  the  use  of  temporal  changes  in  mammographic  features 
between  current  and  previous  mammograms  of  the  patient  is  an  important  component  for  a  successful 
CAD  technique  for  both  the  detection  and  the  classification  tasks.  The  ability  for  automated  analysis  of 
interval  changes  would  significantly  further  the  ability  of  CAD  to  offer  an  objective  second  opinion.  This 
improvement,  in  turn,  could  increase  the  positive  predictive  value  of  mammography,  reduce  the  number  of 
benign  biopsies,  and  hence  reduce  both  cost  and  patient  morbidity. 

While  a  number  of  CAD  schemes  use  only  a  single  mammogram,  the  simultaneous  use  of  more 
than  one  mammogram  has  been  under  investigation  for  some  time.  Several  researchers  have  used  views  of 
the  contra-lateral  breast  for  detecting  masses  and  developing  densities.  For  instance,  Yin  et  al.1 1,12  have 
utilized  architectural  asymmetry  between  the  right  and  left  breasts  to  detect  masses.  While  it  is  widely 
accepted  that  interval  changes  in  mammographic  features  are  very  useful  for  both  detection  and 
classification  of  breast  abnormalities,  the  development  of  CAD  techniques  to  use  this  information  has 
achieved  limited  success13'18.  Sallam  et  al.13  have  proposed  a  warping  technique  for  mammogram 
registration.  They  manually  obtained  control  points  and  calculated  a  mapping  function  for  mapping  each 
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point  on  the  current  mammogram  to  a  point  on  the  previous  mammogram.  The  mapping  function  was 
obtained  based  on  local  affine  transformations,  as  well  as  interpolation  and  surface  fitting  techniques.  A 
drawback  of  this  technique  is  the  need  for  manual  demarcation  of  control  points.  Brzakovic  et  al.14  have 
investigated  a  three-step  method  for  comparison  of  most  recent  and  previous  mammograms.  They  first 
registered  two  mammograms  using  the  method  of  principal  axis,  and  partitioned  the  current  mammogram 
using  a  hierarchical  region-growing  technique.  The  breast  regions  in  the  two  mammograms  were  aligned 
with  respect  to  each  other  by  means  of  translation,  rotation,  and  scaling.  Although  the  technique  was 
evaluated  on  a  total  of  64  images  obtained  from  8  cases,  this  work  mainly  aimed  towards  detecting 
cancerous  changes  in  breast  tissue  and,  therefore,  no  quantitative  analysis  of  registration  accuracy  was 
presented.  Vujovic  et  al.^-16  have  proposed  a  multiple-control-point  technique  for  mammogram 
registration.  They  first  determined  several  control  points  independently  on  the  current  and  previous 
mammograms  based  on  the  intersection  points  of  prominent  anatomical  structures  in  the  breast.  A 
correspondence  between  these  control  points  was  established  based  on  a  search  in  a  local  neighborhood 
around  the  control  point  of  interest.  In  a  more  recent  publication17,  they  have  evaluated  their  approach  for 
establishing  the  correspondence  between  control  points  extracted  from  two  mammograms  using  29 
temporal  image  pairs,  and  presented  a  qualitative  evaluation  based  on  an  observer  study.  They  have 
demonstrated  that  91%  of  103  computer-matched  control  points  were  in  agreement  with  those  matched  by 
a  radiologist.  An  important  assumption  of  their  work  was  that  the  distances  between  the  control  points  did 
not  change  significantly  between  the  two  mammograms.  However,  this  assumption  is  not  necessarily  a 
valid  one.  Variations  in  compression  could  potentially  cause  a  large  variation  in  the  relative  distances 
between  the  control  points.  Also,  these  control  points  representing  the  intersections  of  elongated  structures 
do  not  always  have  correspondences  on  the  two  mammograms.  As  noted  by  the  authors,  the  potential 
control  points  are  not  points  that  are  naturally  selected  by  a  radiologist  when  examining  mammograms. 
Hence,  the  significance  of  these  points  is  debatable. 

The  limited  success  of  the  above  techniques  is  mainly  due  to  the  fact  that  the  extraction  of  any 
meaningful  information  from  previous  mammograms  first  requires  a  common  frame  of  reference  between 
the  cuirent  and  previous  mammograms.  Several  complicating  factors  confound  obtaining  such  a  frame  of 
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reference.  Examples  of  these  factors  include  differences  in  breast  compression  and  positioning  between  the 
current  and  previous  mammograms,  differences  in  the  imaging  technique  between  the  two  examinations, 
and  changes  in  breast  structure,  size  and  tissue  density  between  the  two  images  with  patient  age.  As  a 
result,  the  mammographic  appearance  of  breast  tissue  on  the  current  and  previous  mammograms  of  the 
same  patient  may  vary  considerably.  Although  some  of  the  above-mentioned  factors  might  be  minor,  their 
combined  effect  could  be  significant.  Conventional  registration  techniques  work  well  for  applications 
involving  rigid  objects.  Because  of  the  elasticity  of  the  breast  tissue,  the  absence  of  obvious  landmarks, 
and  the  large  variability  in  the  relative  positions  of  the  breast  tissues  projected  onto  the  mammogram  from 
one  examination  to  the  other,  these  techniques  may  not  be  optimal  for  registration  of  breast  images. 

We  have  developed  a  novel  approach  for  temporal  mammogram  registration  in  which  the  computer 
emulates  the  search  method  used  by  many  radiologists  for  finding  corresponding  structures  on 
mammograms.  The  method  aims  at  registering  a  small  region  containing  a  suspected  mass  on  the  most 
recent  mammogram  of  the  patient  with  one  on  a  mammogram  obtained  from  a  previous  year.  Our  regional 
registration  technique  involves  three  steps:  (1)  identification  of  a  suspicious  structure  on  the  most  recent 
mammogram,  (2)  initial  estimation  of  the  location  on  a  previous  mammogram  of  the  region  corresponding 
to  the  suspicious  structure  and  the  definition  of  a  search  region  which  encloses  the  object  of  interest  on  the 
previous  mammogram,  and  (3)  accurate  identification  of  the  location  of  the  matched  object  within  the 
search  region.  The  characteristic  features  of  the  two  matched  lesions  can  then  be  automatically  extracted 
and  interval  changes  estimated.  This  interval  change  information  can  be  incorporated  in  an  integrated  CAD 
system.  In  the  following  sections  we  will  provide  a  detailed  description  of  our  regional  registration 
technique  tor  temporal  registration  of  mammograms  and  the  results  of  a  quantitative  evaluation  using  a  data 
set  ot  74  temporal  image  pairs.  Although  we  evaluated  a  semi-automated  version  of  the  technique  in  this 
preliminary'  study,  it  can  easily  be  fully  automated  so  that  no  user  interaction  is  required. 

II.  MATERIALS  AND  METHODS 

II. A  Regional  registration  and  mammogram  correspondence 


As  the  term  indicates,  regional  registration  is  a  local  rather  than  a  global  registration  technique.  It  is 
a  multi-step  procedure  and  utilizes  computer-detected  objects  in  the  most  recent  (hereafter  termed  current) 
mammogram.  In  the  context  of  this  paper,  a  current  mammogram  is  either  the  latest  mammogram  of  the 
patient,  or  the  latest  mammogram  before  biopsy.  The  detected  objects  could  be  either  true  masses  (benign 
or  malignant)  or  false  positives  (normal  breast  structures).  Regional  registration  then  finds  a  matching 
object  on  a  previous  mammogram.  The  three  major  steps  in  regional  registration  are  illustrated  in  Figure  1 
and  details  of  the  technique  are  described  below. 

In  the  first  step  of  regional  registration,  the  breast  region  is  segmented  from  the  background  on 
both  the  current  and  the  previous  mammograms.  For  this  purpose  we  have  used  a  breast  boundary 
detection  algorithm  previously  developed  in  our  laboratory19’20.  This  algorithm  could  successfully  track 
the  breast  boundaries  in  over  90%  of  the  1000  mammograms  in  a  previous  study.  It  performed  reliably 
well  on  all  the  images  in  our  database.  After  extracting  the  breast  border  from  the  mammogram,  the 
location  of  the  nipple  is  estimated  on  both  the  current  and  the  previous  mammograms.  Any  automated 
method21-22  can  be  used  for  finding  the  nipple  location.  However,  in  this  study,  the  nipple  location  was 
manually  identified  by  a  radiologist  for  all  images  in  our  data  set.  The  breast  border  and  the  nipple  location 
now  form  the  basis  of  a  global  breast  alignment  (GBA)  procedure  illustrated  in  Figure  2.  Since  the  sizes 
and  the  orientations  of  the  two  images  could  vary  between  the  current  and  previous  mammograms,  a 
common  frame  of  reference  is  needed.  The  GBA  procedure  has  been  devised  specifically  to  provide  such  a 
irame  of  reference.  We  first  define  a  new  frame  of  reference  with  the  nipple  location  on  the  current 
mammogram  (Nc)  as  the  origin.  The  previous  mammogram  is  translated  so  that  its  nipple  location  (Np) 
aligns  with  the  origin  in  the  common  frame  of  reference  as  shown  in  Figure  2.  Using  the  origin  as  the 
pivot  point,  we  rotate  the  previous  mammogram  to  align  the  breast  regions  in  the  two  images. 

We  have  evaluated  two  different  methods  for  estimation  of  the  optimum  rotation  angle.  The  first 
method  is  based  on  maximization  of  the  overlap  area,  and  the  second  method  is  based  on  maximization  of 
the  mutual  information  (MI)23-24  between  the  two  segmented  breast  regions.  To  determine  the  MI,  we  first 
lescale  the  breast  portion  of  both  mammograms  to  a  0-255  gray  scale.  For  a  given  rotation  angle  0,  the 
two-dimensional  (2-D)  histogram  hg  (/,_/’)  of  the  gray  levels  for  the  corresponding  pixels  on  the  current 
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mammogram  and  the  previous  mammogram  is  constructed.  Here  i  refers  to  the  gray  level  on  the  current 
mammogram  and  j  refers  to  the  gray  level  on  the  previous  mammogram  rotated  by  an  angle  0.  The 


probability  density  of  the  gray  scale  co-occurrences  is  estimated  from  the  2-D  histogram  as 
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where  0  <  ij  <  255,0  <m,n<  255.  The  mutual  information  (MIe)  between  the  two  images  for  a  specific 
rotation  angle  0  is  computed  as 
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The  above  procedure  is  repeated  for  several  rotation  angles  and  the  angle  0max  which  provides  the 
maximum  mutual  information  is  chosen  for  global  breast  alignment  of  the  previous  mammogram  and  the 
current  mammogram.  Note  that  while  the  area  overlap  method  for  GBA  uses  the  binary  image  after 
segmentation,  the  MI  based  method  uses  the  original  gray  scale  image.  The  effects  of  the  two  methods  on 
the  accuracy  of  regional  registration  will  be  discussed  later  in  the  Discussion  section.  Once  the  two  images 
are  aligned  in  the  common  frame  of  reference,  the  centroid  of  the  breast  region  is  estimated,  and  the  nipple- 
centroid  axis  is  defined  for  both  mammograms.  For  comparison  we  also  show  in  Section  III  regional 
registration  results  based  on  computing  the  centroids  of  the  two  breast  regions  without  global  breast 
alignment.  The  nipple-centroid  axis  forms  the  basis  for  the  second  step  of  regional  registration. 


In  the  second  step,  suspicious  regions  are  automatically  segmented  from  the  breast  region  on  the 
current  mammogram.  This  can  be  accomplished  by  using  a  density-weighted  contrast  enhancement 
(DWCE)  technique-5  previously  developed  in  our  laboratory.  While  the  use  of  the  DWCE  technique  is  not 
critical  for  regional  registration,  it  does  help  automate  the  entire  procedure.  Alternatively,  a  radiologist  can 
manually  identify  a  suspicious  object  or  a  region  of  interest  on  the  current  mammogram  and  the  regional 
registration  technique  can  be  used  to  identify  a  corresponding  region  on  the  previous  mammogram.  Once 
suspicious  objects  have  been  identified  on  the  current  mammogram,  the  centroid  of  each  object  is 
estimated.  A  polar  coordinate  system  is  then  defined  using  the  nipple  as  the  origin  and  the  nipple-centroid 
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axis  as  the  0°  axis  on  both  images.  This  is  illustrated  in  Figure  3.  The  location  of  the  centroid  of  a 
suspicious  object  on  the  current  mammogram  is  determined  as  (r,0).  We  then  compute  two  scale  factors  - 
the  radial  scale  factor  si  and  the  angular  scale  factor  S2-  These  scale  factors  have  been  devised  to  provide  a 
first  order  correction  for  factors  such  as  breast  compression  differences  between  the  current  and  previous 
mammograms,  differences  in  image  magnification  and  size,  and  changes  in  overall  breast  shape  between 
the  two  images.  The  radial  scale  factor  si  is  estimated  as  the  ratio  of  the  nipple-centroid  distances  on  the 
previous  and  current  images.  The  angular  scale  factor  S2  is  estimated  as  the  ratio  of  the  angular  width  of 
the  breast  on  the  previous  image  at  radius  sjr  to  that  on  the  current  image  at  radius  r.  The  initial  estimate  of 
the  corresponding  location  of  the  suspicious  object  on  the  previous  mammogram  is  then  obtained  as  (sir. 
S20). 

Using  the  initial  estimate  of  the  centroid  of  the  object  on  the  previous  mammogram,  we  can  define 
a  fan-shaped  search  region  bounded  by  sir  ±  6  and  S20  ±  e  as  illustrated  in  Figure  3.  The  object  found  on 
the  current  mammogram  is  then  used  as  a  template  to  search  for  a  matching  object  in  the  search  region  on 
the  previous  mammogram.  The  size  of  the  search  region  (defined  by  5  and  £)  depends  on  the  variability 
between  mammograms  obtained  from  one  examination  to  the  other.  Since  it  is  difficult  to  predict  the 
variability  of  an  elastic  and  deformable  object  such  as  the  breast  by  any  analytical  method,  we  have 
determined  this  variability  experimentally  from  the  mammograms  in  our  data  set.  The  variation  in 
compression  can  cause  a  change  in  the  relative  locations  of  various  breast  structures  on  these  images  as 
well  as  a  rotation  of  the  breast  boundary  with  respect  to  the  fixed  image  coordinates.  By  relating  the 
position  ot  a  breast  structure  to  the  corresponding  nipple-centroid  axis,  and  by  performing  a  search  in  the 
corresponding  search  region,  we  can  reduce  the  effect  of  this  variability.  In  this  study  we  have  estimated 
the  size  of  the  search  region  required  to  enclose  all  corresponding  objects  on  the  previous  mammogram 
using  ground  truth  objects  identified  on  the  previous  mammograms  by  a  radiologist.  The  distance  of  the 

initial  estimate  ot  the  center  of  the  search  region  from  the  centroid  of  the  ground  truth  object  was  also 
estimated. 

The  third  and  final  step  in  the  regional  registration  procedure  involves  a  systematic  search  to 
identity  a  corresponding  structure  within  the  fan-shaped  search  region  on  the  previous  mammogram.  In 
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this  study  we  have  evaluated  two  different  search  criteria.  The  first  criterion  is  based  on  gray  scale  template 
matching.  A  rectangular  gray  scale  template  centered  on  the  mass  centroid  is  extracted  from  the  current 
mammogram.  The  choice  of  the  size  of  the  template  region  can  affect  the  accuracy  of  the  registration 
technique.  The  minimum  required  size  of  a  rectangular  template  is,  of  course,  a  rectangular  region  which 
encloses  the  mass  exactly.  However,  one  can  also  include  a  small  portion  of  the  background  region  in  the 
template.  We  have  analyzed  the  performance  of  our  algorithm  using  two  different  sizes  for  this  template. 
The  first  includes  a  1 -pixel-wide  background  region  all  around  the  boundary  of  the  suspicious  object  while 
the  second  includes  a  5-pixel-wide  background  region.  For  each  pixel  (i,j)  in  the  fan-shaped  region  on  the 
previous  mammogram,  a  region  of  interest  (ROI)  centered  on  the  pixel  and  of  the  same  size  as  the  mass 
template  is  extracted.  We  denote  the  (m,n)th  pixel  in  the  gray  scale  template  extracted  from  the  current 
mammogram  as  p(m,n)  and  that  from  the  ROI  obtained  from  the  fan-shaped  region  as  qij(m,n).  A 
correlation  measure  defined  as 
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is  then  obtained  for  each  pixel  (i,j)  within  the  search  region  on  the  previous  mammogram.  Here  the 
summation  is  performed  over  the  mass  template,  and  p  and  q  denote  the  average  pixel  values  in  the 
template  and  ROI.  respectively.  The  correlation  values  in  the  search  region  are  then  smoothed  by  a  3x3 
averaging  kernel  to  reduce  fluctuations.  The  final  estimate  of  the  location  of  the  mass  centroid  on  the 
previous  mammogram  is  obtained  as  the  location  corresponding  to  maximum  correlation.  The  second 
search  criterion  is  based  on  maximizing  the  mutual  information  between  the  mass  template  and  the  ROI 
extracted  from  within  the  search  region.  The  MI  approach  is  similar  to  that  described  earlier  for  alignment 
of  the  breast  regions,  except  that  the  regions  to  be  matched  are  limited  to  the  size  of  the  mass  template. 

Once  a  corresponding  structure  is  found  on  the  previous  mammogram  for  a  suspicious  object  on 
the  current  mammogram,  it  can  be  used  for  an  interval  change  analysis  within  a  CAD  scheme,  as  we  have 
shown  in  an  independent  study26.  If  the  search  procedure  in  the  fan-shaped  region  does  not  yield  a 
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corresponding  region,  then  the  suspicious  object  on  the  current  mammogram  can  be  considered  as  a  newly 
developed  density.  Objects  for  which  no  corresponding  object  can  be  found  on  the  previous  mammogram 
can  be  analyzed  with  methods  designed  for  single  images  in  an  overall  CAD  scheme.  Note  that  in  this 
study  the  search  techniques  are  structured  in  a  way  to  always  determine  a  matching  object.  Search  criteria 
to  identify  new  densities  will  be  developed  in  future  studies. 

I I.B  Image  acquisition  and  data  set 

The  data  set  for  this  study  consisted  of  127  images  obtained  from  the  files  of  34  patients  who  had 
undergone  biopsy  at  the  University  of  Michigan.  From  these  127  mammograms,  74  temporal  pairs  of 
images  were  obtained.  The  current  mammogram  of  each  temporal  pair  exhibited  a  biopsy-proven  mass. 
Since  some  patient  files  contained  a  sequence  of  mammograms  over  three  years,  the  number  of  temporal 
pairs  was  larger  than  half  the  number  of  images.  The  74  temporal  image  pairs  comprised  of  43  cranio- 
caudal  views  and  3 1  mediolateral-oblique  views.  The  mammograms  of  20  temporal  pairs  were  digitized 
with  a  LUMISYS  DIS-1000  laser  scanner  at  a  pixel  resolution  of  0.1  mm  x  0.1  mm  and  with  12-bit 
resolution.  The  digitizer  was  calibrated  so  that  the  gray  values  were  linearly  and  inversely  proportional  to 
the  optical  density  (OD)  within  the  range  of  0.1  to  2.8  OD  units,  with  a  slope  of  -0.001  OD/pixel  value. 
Outside  this  range,  the  slope  of  the  calibration  curve  decreased  gradually.  The  OD  range  of  this  digitizer 
was  0  to  3.5.  The  mammograms  of  the  remaining  54  temporal  pairs  were  digitized  with  a  LUMISCAN  85 
laser  scanner  at  a  pixel  resolution  of  0.05  mm  x  0.05  mm  and  with  12-bit  resolution.  This  digitizer  was 
calibrated  so  that  the  gray  values  were  linearly  and  inversely  proportional  to  the  OD  within  the  range  0  to  4 
OD  units,  with  a  slope  of -0.001  OD/pixel  value.  All  of  the  images  were  subsequently  reduced  to  0.8  mm 
resolution  by  averaging  adjacent  8x8  pixels  (20  pairs)  or  16x16  pixels  (54  pairs). 

While  the  regional  registration  technique  can  be  used  for  determining  a  corresponding  structure  or 
iegion  tor  any  structure  (both  false  positives  and  masses)  in  the  breast,  in  this  study  we  have  analyzed  its 
accuracy  on  biopsy-proven  masses  alone.  The  location  of  the  mass  on  the  current  mammogram  was 
identified  by  an  MQSA-certified  radiologist  experienced  in  breast  imaging.  The  radiologist  manually 
identified  the  corresponding  region  on  the  previous  mammogram  and  the  nipple  location  on  both  the 
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current  and  the  previous  mammograms  using  an  interactive  image  analysis  tool  on  a  UNIX  workstation. 
For  each  current  mammogram,  the  boundary  of  the  mass  was  manually  delineated  by  the  radiologist  using 
an  image  display  program  developed  in  our  laboratory.  A  bounding  box  enclosing  the  corresponding 
object  on  the  previous  mammogram  was  provided  by  the  radiologist  for  each  of  the  masses.  Each  mass  as 
well  as  the  corresponding  structure  on  the  previous  mammogram  was  rated  for  its  visibility  on  a  scale  of  1 
to  10,  where  the  rating  of  1  corresponded  to  the  most  visible  category.  The  size  of  the  mass  on  the  current 
mammogram  as  well  as  the  size  of  the  corresponding  structure  on  the  previous  mammogram  was  also 
provided  by  the  radiologist.  The  parenchymal  density  was  rated  based  on  the  BIRADS  lexicon.  The 
distributions  of  the  size  and  visibility  ratings  for  benign  and  malignant  cases  in  this  data  set  are  shown  in 
Figures  4  and  5. 

II. C  Evaluation  of  registration  accuracy 

The  bounding  box  enclosing  the  corresponding  object  on  the  previous  mammogram  provided  by 
the  radiologist  was  used  as  the  "ground  truth"  to  evaluate  the  accuracy  of  the  regional  registration 
technique.  We  have  used  two  different  measures  for  assessing  registration  accuracy.  The  first  measure 
quantifies  whether  the  corresponding  region  is  correctly  identified  by  the  registration  algorithm.  This 
measure  is  computed  simply  as  the  number  of  cases  in  which  the  estimated  centroid  location  of  the  mass 
on  the  previous  mammogram  is  inside  the  bounding  box  provided  by  the  radiologist.  The  second  measure 
quantities  the  error  in  the  estimate  of  the  corresponding  region  on  the  previous  mammogram  and  is  defined 
as  the  Euclidean  distance  between  the  estimated  centroid  of  the  corresponding  region  and  the  center  of  the 
bounding  box  provided  by  the  radiologist.  Together  these  two  measures  answer  the  questions:  (a)  does 
regional  registration  work?  (b)  how  well  does  the  technique  perform  in  matching  structures  between  the 
current  and  previous  mammograms?  In  the  next  section  we  provide  the  results  of  regional  registration  with 
and  without  global  breast  alignment  and  using  both  correlation  and  mutual  information  as  the  search 
criterion  in  Step  3. 

III.  RESULTS 
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To  provide  the  reader  with  a  qualitative  idea  of  algorithm  performance  we  first  illustrate  the 
intermediate  results  at  various  stages  of  the  algorithm.  Then  the  results  of  each  of  the  three  steps  of  the 
algorithm  are  presented  with  an  analysis  of  the  dependence  of  the  performance  on  various  algorithm 
parameters.  Also  presented  is  an  analysis  of  the  accuracy  of  regional  registration  using  the  error  measures 
defined  in  Section  He.  In  the  following  sections,  the  term  "initial  estimate"  refers  to  the  estimate  of  the 
center  of  the  search  region  in  Step  2  of  regional  registration.  The  term  "final  estimate"  refers  to  the 
outcome  of  the  search  procedure  adopted  in  Step  3  and  represents  the  overall  result  of  regional  registration. 
Intermediate  Results  of  Regional  Registration 

Figures  6-8  shows  an  example  of  the  intermediate  and  final  results  of  applying  the  regional 
registration  technique  to  a  temporal  pair  of  mammograms.  The  original  digitized  mammograms  -  current 
and  previous  -  with  the  automatically  tracked  breast  boundaries  superimposed,  are  shown  in  Figure  6.  The 
location  of  the  mass  on  the  current  mammogram  is  shown  in  Figure  7  along  with  the  corresponding 
radiologist-identified  region  on  the  previous  mammogram.  Figure  8  shows  the  fan-shaped  search  region 
on  the  previous  mammogram  estimated  in  Step  2  of  regional  registration.  The  initial  estimate  is  at  the 
center  of  this  search  region  which  is  to  be  used  in  Step  3  for  localization  of  the  corresponding  mass.  The 
centroid  location  of  the  corresponding  object  estimated  by  the  algorithm  using  the  correlation  measure  as 
the  search  criterion  is  also  shown  in  Figure  8. 

Initial  Estimates  and  Search  Regions 

Figure  9  shows  histograms  of  the  Euclidean  distance  between  the  initial  estimate  of  the  centroid 
location  of  the  corresponding  structure  on  the  previous  mammogram  and  the  center  of  the  bounding  box 
provided  by  the  radiologist.  For  the  74  temporal  image  pairs  used  in  this  data  set,  the  average  Euclidean 
distance  error  of  the  initial  estimate  was  10.5  mm  (std.  dev.  6.4  mm)  without  the  GBA  procedure  and  9.8 
mm  (std.  dev.  6.0  mm)  with  the  GBA  procedure.  The  overall  accuracy  was  46%  in  both  cases,  i.e.,  in  34 
ot  the  74  temporal  image  pairs  the  initial  estimate  was  inside  the  ground-truth  bounding  box.  Based  on 
observation  ot  the  radial  deviation  errors  and  the  angular  deviation  errors  (defined  in  Section  IV)  in 
Figures  10  and  1 1,  a  search  region  defined  by  e  =  0.35  +  5/r  radians  and  5  =  20  mm  with  GBA  (8  =  25 
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mm  for  no  GBA),  where  r  is  the  radial  distance  from  the  nipple,  was  used  for  the  evaluation  of  the  local 
search  criteria  used  in  Step  3  of  regional  registration. 

Local  Search  Criteria  and  Final  Estimates 

Figure  12  shows  the  histograms  of  the  Euclidean  distance  errors  of  the  final  estimate  of  the 
corresponding  structure  using  the  correlation  measure  as  the  search  criterion.  Table  I  summarizes  the 
results  along  with  the  average  Euclidean  distance  errors  and  standard  deviations  using  both  the  correlation 
and  the  mutual  information  search  criteria  and  with  and  without  the  GBA  procedure.  The  average 
Euclidean  distance  errors  and  deviations  for  the  cases  where  the  final  estimate  is  inside  the  ground-truth 
region  identified  by  the  radiologist  and  the  cases  where  it  is  outside  are  also  listed  separately.  Regional 
registration  incorporating  the  GBA  procedure  and  using  correlation  as  a  search  criterion  has  an  accuracy  of 
85%.  In  63  of  the  74  temporal  image  pairs,  the  final  estimate  of  the  location  of  the  corresponding  region 
was  inside  the  radiologist-identified  ground-truth  region.  The  use  of  mutual  information  as  a  search 
criterion  yielded  an  accuracy  of  74%  (55  out  of  74  temporal  pairs).  The  average  Euclidean  distance  error 
for  regional  registration  incorporating  GBA  and  correlation  was  4.7  mm  (std.  dev.  5.8  mm)  for  all  74 
temporal  pairs  and  2.8  mm  (std.  dev.  1.9  mm)  in  85%  (63/74)  of  the  temporal  pairs.  Use  of  mutual 
information  as  a  search  criterion  in  Step  3  results  in  values  of  7.2  mm  (std.  dev.  8.6  mm)  and  3.0  mm 
(std.  dev.  2.0  mm),  respectively,  for  the  same  quantities. 

IV.  DISCUSSION 

Initial  Estimates  and  Search  Regions 

From  the  histograms  of  Figure  9,  we  observe  that  the  use  of  the  GBA  procedure  results  only  in  a 
marginal  improvement  in  the  initial  estimate,  if  the  Euclidean  distance  error  is  the  only  measure  considered. 
However,  the  GBA  procedure  has  a  significant  effect  in  reducing  the  size  of  the  search  region  required  for 
regional  registration.  In  order  to  compute  the  required  sizes  (5  and  e  in  Figure  3)  of  the  search  region,  we 
computed  two  quantities  -  the  radial  distance  deviation  and  the  angular  deviation  -  using  the  initial  estimate 
obtained  trom  Step  2  for  the  74  temporal  image  pairs.  The  radial  distance  deviation  is  defined  as  the 
absolute  difference  between  s i r  and  rc,  where  rc  is  the  radial  distance  of  the  center  of  the  ground-truth 
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region  from  the  nipple  location  on  the  previous  mammogram.  The  histograms  of  radial  distance  deviations 
for  the  74  temporal  image  pairs  with  and  without  the  GBA  procedure  are  shown  in  Figure  10.  An 
important  observation  is  that  a  5  value  of  25  mm  is  needed  to  include  the  centers  of  the  ground-truth 
structures  if  the  GBA  procedure  is  not  used  in  Step  1.  The  use  of  the  GBA  procedure  results  in  a  decrease 
in  the  value  of  5  to  20  mm.  This  decrease  helps  significantly  increase  the  overall  accuracy  of  the  regional 
registration  as  discussed  below. 

In  Figure  1 1  the  angular  deviation  of  the  initial  estimate  is  plotted  against  the  radial  distance  of  the 
centers  of  the  ground-truth  regions  on  the  previous  mammogram.  The  angular  deviation  e  is  defined  as  S20 
-  0C  where  0C  is  the  angle  between  the  nipple-ground-truth  center  vector  and  the  nipple-centroid  axis.  In  an 
earlier  study22  using  both  false  positives  and  masses,  we  have  observed  that  the  value  of  £  needed  to 
include  the  center  of  the  ground-truth  region  decreases  with  distance  from  the  nipple,  i.e.,  increases  with 
distance  from  the  chest  wall.  This  may  be  attributed  to  the  increased  deformability  of  the  breast  tissue 
closer  to  the  nipple  compared  to  the  tissue  closer  to  the  chest  wall.  This  indicates  that  a  possible  approach 
to  take  into  account  this  variability  is  to  incorporate  a  variable  £,  one  which  is  inversely  proportional  to  the 
radial  distance  r  from  the  nipple.  For  the  data  set  in  this  study,  we  have  investigated  several  forms  for  this 
dependence  all  of  which  fit  under  the  general  model 

£  =  £th  +  K/r. 

Here  £th  and  K  are  two  constants  which  affect  the  form  of  the  dependency.  Based  on  our  observation  of 
the  angular  deviations  for  the  entire  data  set  of  74  temporal  pairs  we  have  chosen  £lh  =  0.35  radians  and  K 
=  5  radians-mm.  As  can  be  seen  from  Figure  11,  with  these  values  of  £th  and  K,  all  of  the  centers  of  the 
ground-truth  regions  are  within  the  search  region.  Therefore,  a  search  region  defined  by  £  =  0.35  +  5/r 
radians,  and  8  =  20  mm  (if  GBA  was  applied)  or  5  =  25  mm  (if  GBA  was  not  applied)  was  used  for 
evaluation  ot  the  local  search  criteria  used  in  Step  3  of  regional  registration. 

Local  Search  Criteria  and  Final  Estimates 

We  have  evaluated  the  use  of  correlation  and  mutual  information  as  the  local  search  criteria.  From 
Table  1  we  observe  that  the  GBA  procedure  results  in  a  higher  accuracy  irrespective  of  the  search  criterion. 
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While  the  use  of  mutual  information  as  a  search  criterion  performs  reasonably  well  by  itself  (740-  accuracx 
with  an  average  error  of  7.2  mm)  the  use  of  correlation  measure  was  observed  to  result  in  more  accurate 
registration.  For  the  images  in  this  data  set,  the  correlation  measure  out-performed  the  mutual  information 
measure  irrespective  of  whether  the  breast  centroids  were  computed  with  or  without  the  GBA  procedure. 

A  few  observations  on  the  1 1  cases  where  the  final  estimate  was  outside  the  radiologist-identified 
ground-truth  corresponding  region  are  in  order.  In  7  of  the  11  cases  although  the  radiologist  did  provide  a 
region  corresponding  to  the  mass  on  the  current  mammogram,  the  corresponding  structure  on  the  previous 
mammogram  was  very  subtle  (visibility  rating  8  or  higher)  with  indistinct  boundaries.  The  radiologist 
could  only  estimate  the  region  where  the  mass  would  develop  rather  than  the  mass  itself,  so  the  truth  was 
uncertain.  In  one  of  the  remaining  4  cases,  the  mass  an  architectural  distortion  in  the  current  mammogram. 
In  a  second  (benign)  case  the  mass  shape  had  changed  considerably.  Upon  consultation  of  the  pathology 
report,  the  radiologist  concluded  that  the  mass  was  a  benign  cyst  which  had  been  aspirated  in  the  previous 
year  resulting  in  a  substantial  change  in  its  shape.  In  the  third  case,  the  proximity  of  the  mass  to  the  chest 
wall  resulted  in  it  being  incompletely  imaged  in  the  previous  year  compared  to  the  current  year.  In  such 
cases  the  correlation  measure  of  a  neighboring  breast  structure  would  tend  to  be  higher  than  that  of  the 
corresponding  structure.  In  the  fourth  case,  an  overlap  of  two  vessels  was  identified  as  corresponding  to 
the  mass  on  the  current  mammogram  while  the  region  corresponding  to  the  mass  was  observed  to  be 
extremely  subtle.  In  almost  all  of  the  1 1  cases  the  proximity  of  the  corresponding  region  to  a  dense 
structure  combined  with  the  subtle  nature  of  the  structure  on  the  previous  mammogram  render  the 
correlation  measure  ineffective  in  establishing  correspondence.  However,  in  clinical  practice,  these  masses 
will  likely  be  categorized  as  a  newly  developed  density.  Criteria  to  distinguish  a  newly  developed  density 
will  be  investigated  in  further  studies. 

GBA:  Area  overlap  vs.  Mutual  information 

For  the  images  used  in  this  study,  the  result  of  the  GBA  procedure  based  on  maximizing  the  area 
overlap  between  the  breast  regions  in  the  two  images  of  a  temporal  pair  is  comparable  to  that  based  on 
maximizing  the  mutual  information.  However,  our  observation  is  that  the  mutual  information  criterion  is 
preferable  to  the  area  overlap  criterion.  The  area  overlap  measure  suffers  from  the  drawback  that  if  the 


15 


breast  region  in  one  of  the  mammograms  is  uniformly  smaller  than  that  in  the  other,  i.e..  the  breast  edge  in 
one  is  completely  within  the  breast  edge  in  the  other,  then  there  is  no  unique  rotation  angle  at  which  the 
area  overlap  is  maximized.  Although  the  range  of  rotation  angles  over  which  local  maxima  of  the  area 
overlap  occur  is  small,  the  resulting  estimate  of  the  rotation  angle  for  GBA  may  be  sub-optimal.  The  use  of 
mutual  information,  however,  results  in  a  single  unique  rotation  angle  at  which  MI  is  maximized.  In  any 
case,  as  discussed  earlier,  the  use  of  the  GBA  procedure  before  computing  the  breast  centroid  results  in  a 
reduction  in  the  size  of  the  search  region.  A  smaller  search  region  reduces  the  likelihood  that  the  mass 
template  is  matched  to  an  incorrect  structure  and,  therefore,  increases  the  accuracy  and  reduces  the 
Euclidean  distance  error. 

Template  Size,  Scale  Factors  and  Computation  times 

The  size  of  the  background  region  in  the  gray  scale  template  extracted  from  the  current 
mammogram  affects  registration  accuracy.  For  the  74  temporal  pairs  in  this  data  set,  the  best  performance 
was  observed  when  a  1 -pixel-wide  background  region  was  included  all  around  the  boundary  of  the  mass 
template.  A  5-pixel-wide  background  region  resulted  in  a  decrease  in  accuracy  and  an  increase  in  the 
average  Euclidean  distance  error.  The  accuracy  progressively  decreased  and  the  Euclidean  distance  error 
increased  with  an  increase  in  the  size  of  the  background  region  in  the  template.  The  radial  scale  factor  sj 
ranged  from  0.94  to  1.05  for  this  data  set.  Use  of  si  reduced  the  size  of  the  search  area  by  decreasing  the 
required  value  for  8.  The  angular  scale  factor  S2  was  very  close  to  1  in  all  cases  and  did  not  seem  to  make 
any  major  difference  for  the  images  in  this  data  set.  On  a  final  note  the  computation  time  required  for 
regional  registration  incorporating  correlation  was  on  the  average  2  sec  without  GBA  and  4  sec  with  GBA 
on  a  UNIX  workstation  (DEC  Alphastation  600  series). 

V.  CONCLUSIONS 

Radiologists  are  interested  in  determining  any  local  changes  in  breast  tissue  over  time  which  may 
indicate  a  developing  cancer.  We  have  developed  a  novel  regional  registration  technique  for  temporal 
registration  ot  mammograms.  This  technique  could  become  an  important  component  of  a  CAD  scheme  for 
mammographic  analysis.  Unlike  other  techniques  found  in  the  literature,  our  regional  registration 
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technique  does  not  depend  on  the  identification  of  landmark  structures  or  control  points  on  the 
mammograms.  It  is  based  on  a  search  technique  that  many  radiologists  use  and  has  proven  to  be 
successful  in  mammographic  interpretation.  After  corresponding  objects  are  found,  they  can  be  analyzed 
for  interval  changes  in  a  CAD  scheme.  Our  preliminary  results  indicate  that  the  regional  registration 
technique  is  promising  in  identifying  corresponding  regions  from  temporal  mammographic  pairs.  In  859r 
(63/74)  of  the  cases  the  regional  registration  technique  correctly  identified  the  corresponding  region  in  the 
previous  mammogram.  For  these  63  cases,  it  is  highly  encouraging  to  note  that  the  estimated  location  of 
the  region  corresponding  to  the  mass  in  the  current  mammogram  was  less  than  3  mm  on  the  average  from 
radiologist-identified  corresponding  locations. 

Areas  for  future  work  include  the  development  of  an  automated  technique  for  identifying  the  nipple 
location  on  the  mammograms,  investigation  of  other  local  search  criteria  such  as  Fourier  descriptors  and 
shape-invariant  moments  to  be  used  in  the  fan-shaped  search  region,  adaptive  methods  for  determining  the 
size  of  the  search  region,  criteria  for  identifying  newly  developed  densities,  application  of  regional 
registration  to  false  positives  as  well  as  masses,  and  studies  with  a  large  data  set  to  investigate  the 
robustness  of  the  regional  registration  technique.  It  may  be  noted  that  the  regional  registration  technique 
may  also  be  applicable  to  other  related  registration  problems,  such  as  the  registration  of  left  and  right 
mammograms. 
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Table  I.  Accuracy  of  regional  registration  using  correlation  measure  and  mutual  information  measure  in  Step 
3  with  and  without  global  breast  alignment  (GBA)  and  using  a  1-pixel-wide  background  region  for  the 
template  from  the  current  mammogram.  Correct  estimates  are  the  cases  where  the  estimated  centroid  location 
was  within  the  bounding  box  of  the  radiologist-identified  object  location. 


Method 

Accuracy 

Overall  average 
error  (mm) 

Average  error 
(mm)  for 
correct 
estimates 

Average  error 
(mm)  for 
incorrect 
estimates 

Correlation 
without  GBA 

77%  (57/74) 

7.4  ±10.2 

2.8  ±2.0 

22.9  ±11.5 

Mutual 
information 
without  GBA 

68%  (50/74) 

8.8  ±10.5 

3.0  ±2.0 

20.7  ±11.1 

Correlation 
with  GBA 

85%  (63/74) 

4.7  ±5.8 

2.8  ±1.9 

15.7  ±8.3 

Mutual 
information 
with  GBA 

74%  (55/74) 

7.2  ±8.6 

3.0  ±2.0 

19.4  ±8.9 
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Figure  Captions 

Figure  1.  Regional  registration  technique  for  determining  an  object  on  the  previous  mammogram  which 
corresponds  to  a  suspicious  object  on  the  most  recent  or  current  mammogram. 

Figure  2.  Global  breast  alignment  based  on  the  mutual  information  between  the  two  breast  regions.  Nc  - 
nipple  location  in  current  mammogram,  Np  -  nipple  location  in  previous  mammogram.  N  -  nipple  location 
for  both  current  and  previous  mammograms  after  translating  them  to  the  common  frame  of  reference.  The 
previous  mammogram  is  rotated  until  the  mutual  information  between  the  two  mammograms  is  maximized. 

Figure  3.  Polar  coordinate  system  defined  using  the  nipple  location  and  the  nipple-centroid  axis.  The  search 
region  for  finding  a  matching  object  on  the  previous  mammogram  is  shown  as  the  shaded  region. 

Figure  4.  Distribution  of  the  size  of  the  mass  on  the  current  mammogram  with  respect  to  the  size  of  the 
corresponding  structure  on  the  previous  mammogram  as  estimated  by  an  experienced  breast  radiologist  for 
benign  (B)  and  malignant  (M)  cases  in  the  data  set. 

Figure  5.  Distribution  of  the  visibility  of  the  mass  on  the  current  mammogram  with  respect  to  the  visibility  of 
a  corresponding  structure  on  the  previous  mammogram  as  rated  by  an  experienced  breast  radiologist  for 
benign  (B)  and  malignant  (M)  cases.  In  this  rating  scale  the  visibility  of  the  masses  decreases  from  1  to  10 
with  10  being  the  least  visible.  The  total  number  of  points  in  these  two  graphs  is  less  than  the  total  number  of 
mammogram  pairs  in  out  database,  because  mammogram  pairs  with  the  same  rating  appear  as  a  single  point. 

figure  6.  Left  -  most  recent  or  current  mammogram.  Right  -  previous  mammogram.  The  breast  images  are 
superimposed  with  the  breast  borders  detected  by  a  breast  boundary  tracking  algorithm. 

I-igure  7.  Left  -  location  of  the  mass  on  the  current  mammogram.  Right  -  radiologist-identified  region  on 
pre\  ious  mammogram  corresponding  to  the  mass  on  the  current  mammogram. 

Figure  8.  The  fan-shaped  search  region  on  the  previous  mammogram.  The  initial  computer  estimate  of  the 
centroid  location  of  the  region  corresponding  to  the  mass  is  at  the  center  of  the  search  region.  The  final 
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estimate  of  the  centroid  of  the  corresponding  region  (indicated  by  X)  is  obtained  by  using  the  correlation 
criterion  within  the  fan-shaped  search  region. 

Figure  9.  Histograms  of  Euclidean  distance  between  the  initial  estimate  of  the  centroid  location  of  the 
corresponding  object  and  the  center  of  the  radiologist-identified  object  on  the  previous  mammogram  with 
and  without  GBA. 

Figure  10.  Histograms  of  radial  distance  deviation  between  the  initial  estimate  of  the  centroid  location  of  the 
corresponding  object  and  the  center  of  the  radiologist-identified  object  on  the  previous  mammogram  with 
and  without  GBA. 

Figure  11.  Angular  deviation  between  the  initial  estimate  of  the  centroid  location  of  the  corresponding  object 
and  the  center  of  the  radiologist-identified  object  on  the  previous  mammogram  with  and  without  GBA.  Also 
shown  are  the  bounding  lines  defined  using  £  =  0.35  +  5/r  radians. 

Figure  12.  Histograms  of  Euclidean  distance  error  for  corresponding  regions  estimated  by  regional 
registration  using  the  correlation  measure  in  Step  3  with  and  without  GBA.  This  error  is  defined  as  the 
Euclidean  distance  between  the  centroid  location  of  the  estimated  corresponding  region  and  the  center  of  the 
radiologist-identified  ground-truth  corresponding  region  on  the  previous  mammogram. 
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Figure  1.  Regional  registration  technique  for  determining  an  object  on  the  previous  mammogram  which 
corresponds  to  a  suspicious  object  on  the  most  recent  or  current  mammogram. 
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Figure  2.  Global  breast  alignment  based  on  the  mutual  information  between  the  two  breast  regions.  Nc  - 
nipple  location  in  current  mammogram,  Np  -  nipple  location  in  previous  mammogram,  N  -  nipple  location 
for  both  current  and  previous  mammograms  after  translating  them  to  the  common  frame  of  reference.  The 
previous  mammogram  is  rotated  until  the  mutual  information  between  the  two  mammograms  is  maximized. 
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Figure  3.  Polar  coordinate  system  defined  using  the  nipple  location  and  the  nipple-centroid  axis.  The  search 
region  for  finding  a  matching  object  on  the  previous  mammogram  is  shown  as  the  shaded  region. 
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Figure  4.  Distribution  of  the  size  of  the  mass  on  the  current  mammogram  with  respect  to  the  size  of  the 
corresponding  structure  on  the  previous  mammogram  as  estimated  by  an  experienced  breast  radiologist  for 
benign  (B)  and  malignant  (M)  cases  in  the  data  set. 
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Figure  5.  Distribution  of  the  visibility  of  the  mass  on  the  current  mammogram  with  respect  to  the  visibility  of 
a  corresponding  structure  on  the  previous  mammogram  as  rated  by  an  experienced  breast  radiologist  for 
benign  (B)  and  malignant  (M)  cases.  In  this  rating  scale  the  visibility  of  the  masses  decreases  from  1  to  10 
with  10  being  the  least  visible.  The  total  number  of  points  in  these  two  graphs  is  less  than  the  total  number  of 
mammogram  pairs  in  out  database,  because  mammogram  pairs  with  the  same  rating  appear  as  a  single  point. 
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Figure  6.  Left  -  most  recent  or  current  mammogram.  Right  -  previous  mammogram.  The  breast  images  are 
superimposed  with  the  breast  borders  detected  by  a  breast  boundary  tracking  algorithm. 


Figure  7.  Left  -  location  of  the  mass  on  the  current  mammogram.  Right  -  radiologist-identified  region 
previous  mammogram  corresponding  to  the  mass  on  the  current  mammogram. 


Figure  8.  The  fan-shaped  search  region  on  the  previous  mammogram.  The  initial  computer  estimate  of  the 
centroid  location  of  the  region  corresponding  to  the  mass  is  at  the  center  of  the  search  region.  The  final 
estimate  of  the  centroid  of  the  corresponding  region  (indicated  by  X)  is  obtained  by  using  the  correlation 
criterion  within  the  fan-shaped  search  region. 
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Figure  9.  Histograms  of  Euclidean  distance  between  the  initial  estimate  of  the  centroid  location  of  the 
corresponding  object  and  the  center  of  the  radiologist-identified  object  on  the  previous  mammogram  with 
and  without  GBA. 
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Radial  deviation  error  (mm)  Radial  deviation  error  (mm) 

Figure  10.  Histograms  of  radial  distance  deviation  between  the  initial  estimate  of  the  centroid  location  of  the 
corresponding  object  and  the  center  of  the  radiologist-identified  object  on  the  previous  mammogram  with 
and  without  GBA. 
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1‘igure  11.  Angular  deviation  between  the  initial  estimate  of  the  centroid  location  of  the  corresponding  object 
and  the  center  of  the  radiologist-identified  object  on  the  previous  mammogram  with  and  without  GBA.  Also 
shown  are  the  bounding  lines  defined  using  £  =  0.35  +  5/r  radians. 
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Figure  12.  Histograms  of  Euclidean  distance  error  for  corresponding  regions  estimated  by  regional 
registration  using  the  correlation  measure  in  Step  3  with  and  without  GBA.  This  error  is  defined  as  the 
Euclidean  distance  between  the  centroid  location  of  the  estimated  corresponding  region  and  the  center  of  the 
radiologist-identified  ground-truth  corresponding  region  on  the  previous  mammogram. 
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